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Abstract 


The  Cramer- Rao  error  bound  provides  a  fundamental  limit  on  the  expected  performance  of 
a  statistical  estimator.  The  error  bound  depends  on  the  general  properties  of  the  system,  but 
not  on  the  specific  properties  of  the  estimator  or  the  solution.  The  Cramer-Rao  error  bound 
has  been  applied  to  scalar-  and  vector-valued  estimators  and  recently  to  parametric  shape 
estimators.  However,  nonparametric,  low-level  surface  representations  are  an  important 
important  tool  in  3D  reconstruction,  and  are  particularly  useful  for  representing  complex 
scenes  with  arbitrary  shapes  and  topologies.  This  paper  presents  a  generalization  of  the 
Cramer-Rao  error  bound  to  nonparametric  shape  estimators.  Specifically,  we  derive  the 
error  bound  for  the  full  3D  reconstruction  of  scenes  from  multiple  range  images. 


Chapter  1 
Introduction 


A  confluence  of  several  technologies  has  created  new  opportunities  for  reconstructing  3D 
models  of  complex  objects  and  scenes.  More  precise  and  less  expensive  range  measure¬ 
ment  systems  combined  with  better  computing  capabilities  enable  us  to  build,  visualize, 
and  analyze  3D  models  of  the  world.  The  difficulty  of  reconstructing  surfaces  from  range 
images  stems  from  inadequacies  in  the  data.  Range  measurements  presents  several  signifi¬ 
cant  problems,  such  as  measurement  noise,  variations  in  measurement  density,  occlusions, 
and  errors  in  the  registration  of  multiple  range  images.  Hence,  the  reconstructed  surfaces 
are  not  perfect,  they  are  merely  estimates  of  the  true  surfaces.  As  the  use  of  measured 
3D  models  becomes  more  commonplace,  there  will  be  a  greater  need  for  quantifying  the 
errors  associated  with  these  models.  For  instance,  the  use  of  3D  models  in  forensics,  to 
model  crime  scenes  [1],  will  invariably  raise  the  question,  “How  much  can  we  trust  these 
models?”1 

Signal  processing,  and  estimation  theory  in  particular,  provides  a  tool,  the  Cramer-Rao 
error  bound  (CRB),  for  quantifying  the  performance  of  statistical  estimators.  However,  the 
CRB  has  traditionally  been  applied  to  parameter  estimation  problems.  That  is,  problems 
in  which  the  number  of  parameters  and  their  relationship  to  the  physical  measurements  is 
fixed  and  known.  In  order  apply  these  tools  to  surface  reconstruction,  we  must  first  define 
a  notion  of  error  for  surfaces  and  then  adapt  these  tools  to  a  3D  geometric  setting. 

The  analysis  of  reconstruction  errors  depends  on  the  surface  representation.  For  this  discus¬ 
sion  we  divide  the  space  of  surface  models  into  two  classes:  parametric  and  nonparametric. 
Parametric  models  are  those  that  represent  shapes  indirectly  via  a  finite  set  of  variables  that 

1  http://www.3rdtech.com/DeltaSpherejt_AAFS_Conf.htm 
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control  the  local  or  global  position  of  the  surface.  Parametric  models  range  from  simple 
primitives  that  have  a  few  parameters  to  more  complicated  algebraic  polynomial  surfaces 
and  piecewise  smooth  models,  such  as  splines.  Parametric  approaches  are  particularly  well 
suited  to  higher-level  tasks  such  as  object  recognition.  In  the  context  of  estimation,  the 
number  of  parameters  and  their  relationship  to  the  shape  is  not  usually  considered  as  a  ran¬ 
dom  variable.  Therefore,  parametric  models  restrict  the  solution  to  the  space  of  shapes  that 
are  spanned  by  the  associated  parameters. 

The  alternative  is  a  nonparametric  model,  which,  for  the  purposes  of  this  paper,  refers  to 
those  representations  in  which  the  position  of  any  point  on  the  surface  is  controlled  directly 
and  is  independent  (to  within  a  finite  resolution)  from  the  positions  of  other  points  on  the 
surface.  According  to  this  definition,  surface  meshes,  volumes,  and  level  sets  are  examples 
of  nonparametric  shape  representations.  Nonparametric  models  typically  have  many  more 
free  parameters  (e.g.  each  surface  point,  their  number,  and  their  configuration)  and  they 
represent  a  much  broader  class  of  shapes.  However,  nonparametric  models  impose  other 
limitations  such  as  finite  resolution  and,  in  the  case  of  implicit  models,  closed  boundaries. 
Nevertheless,  the  literature  has  shown  that  nonparametric  models  are  preferred  when  re¬ 
constructing  surfaces  of  complex  objects  or  scenes  with  arbitrarily  topology  and  very  little 
a-priori  knowledge  about  shape  [2,  3,  4,  5].  This  paper  introduces  a  novel  formulation  for 
computing  expected  errors  of  nonparametric  surface  estimates  using  point-wise  Cramer- 
Rao  bounds. 

The  rest  of  this  report  is  organized  as  follows.  Chapter  2  discusses  related  work,  Chapter  3 
summarizes  the  maximum  likelihood  nonparametric  surface  estimation  process,  and  Chap¬ 
ter  4  derives  a  CRB  for  nonparametric  surface  estimators  and  gives  results  for  synthetic 
data.  Chapter  5  presents  results  for  real  data.  Chapter  6  summarizes  the  contributions  of 
this  paper  and  discusses  possibilities  for  future  research  directions. 


Chapter  2 
Related  Work 


The  CRB  states  the  minimum  achievable  error  for  an  estimator,  and  therefore,  provides 
fundamental  limits  on  the  performance  of  any  estimation  process.  The  expression  for  the 
CRB  is  independent  of  the  specific  form  of  the  estimator;  it  depends  only  on  the  statistics 
of  the  input  measurements  and  the  bias  of  the  estimator.  Moreover,  for  asymptotically 
efficient  estimators,  such  as  the  maximum  likelihood  estimator  (MLE),  the  CRB  is  a  tight 
lower  bound,  i.e.  for  MLEs  the  CRB  is  achievable.  Thus,  the  CRB  quantifies  the  expected 
error  of  the  output  of  an  estimation  process  in  the  absence  of  ground  truth.  In  the  context 
of  surface  reconstruction,  it  provides  a  well-founded,  systematic  mechanism  for  computing 
the  error  of  a  reconstructed  surface. 

Researchers  have  extensively  used  CRBs  for  problems  where  the  estimator  is  relatively 
simple,  such  as  scalar  or  vector  quantities.  For  instance,  parameter  estimation  to  deter¬ 
mine  the  location,  size  and  orientation  of  a  target  has  been  studied  using  CRB  analysis  [6]. 
More  recently,  several  authors  have  derived  CRB  expressions  for  parametric  shape  estima¬ 
tors.  Hero  et  al.  [7]  compute  the  CRB  for  B-spline  parameters  of  star-shapes  estimated 
from  magnetic  resonance  imagery.  Ye  et  al.  [8]  compute  the  CRB  for  more  general 
parametric  shape  estimators.  Confidence  intervals  for  shape  estimators  can  be  computed 
using  CRBs  [9],  which  provides  an  important  computational  advantage  over  using  a  Monte- 
Carlo  simulation  [10].  However,  these  results  apply  only  to  parametric  shape  estimators. 
The  goal  of  this  paper  is  to  fill  an  gap  in  3D  surface  reconstruction  by  deriving  the  CRB  for 
nonparametric  shape  estimators  and  expressing  the  error  in  terms  of  a  statistical  model  of 
a  scanning  laser  range  finder. 
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Chapter  3 

Maximum  Likelihood  Surface 
Reconstruction 


This  chapter  describes  a  particular  formulation  for  a  nonparametric  MLE  surface  estimator. 
The  results  in  this  paper  establish  a  bound  that  applies  to  any  nonparametric  surface  estima¬ 
tor.  However,  these  results  provide  a  tight  bound  for  MLE  estimators,  and  the  formulation 
for  the  MLE  estimator  introduces  some  basic  concepts  that  are  important  for  the  CRB. 

We  begin  by  describing  a  mathematical  model  of  a  range  image.  A  range  finder  is  a  device 
that  measures  distances  to  the  closest  point  on  an  object  along  a  particular  line  of  sight.  A 
range  scanner  produces  a  2D  array  (image)  of  range  measurements  rU].  through  a  scanning 
mechanism  that  aims  the  line  of  sight  accordingly,  see  Figure  3.1.  Therefore  each  element 
or  pixel  of  a  range  image  consists  of  two  things:  a  line  of  sight  and  a  range  measurement, 
which  together  describe  a  3D  point.  We  denote  a  single  range  image  and  a  collection 
of  range  images  taken  from  different  scanner  locations  as  {P^, ...,  R^}. 

The  object  or  scene  also  requires  a  precise  specification.  We  define  the  surface  S  as  the 
closure  of  a  compact  subset  of  3D,  fi.  Thus,  S  is  the  “skin”  that  covers  the  solid  Q. 

The  range  measurements  are  random  variables,  but  if  we  know  the  sensor  model,  we  can 
compute  the  probability  of  a  particular  set  of  range  image  conditional  on  the  scene  as 
P  ...,  P^M)  \S) .  This  is  the  likelihood.  An  MLE  estimator  is  defined  as 

S  =  argsupP  (P(1), ...,  P(M)|P).  (3.1) 

s 


Any  estimator  that  minimizes  the  likelihood  is  asymtotically  efficient  and  unbiased.  That 
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Figure  3.1:  A  range  finder  produces  a  dense  range  map  of  a  scene. 

is,  as  the  number  of  measurements  goes  to  infinity,  the  estimator  is  correct  on  the  average 
and  is  as  good  as  any  other  unbiased  estimator. 

Whitaker  [5]  shows  that  the  maximum  likelihood  estimator  of  such  a  collection  of  range 
images  can  be  computed  as  the  set  of  zero  crossings  of  scalar  function  G(x).  That  is 

S  =  {x  e  IR3  |  G(x)  =  0}  ,  (3.2) 

Curless  [3]  uses  a  similar  implicit  formulation  to  reconstruct  surfaces  from  multiple  range 
scans. 

For  the  MLE  formulation  G(x)  is 


M 

G(x)  =  (33) 

3= 1 

where  Dj(x)  is  the  distance  from  the  f  th  scanner  location  to  the  point  x  e  IR3,  and  h  is  the 
derivative  of  the  logarithm  of  the  pdf  for  the  range  measurement  error  model.  The  model 
assumes  that  the  range  measurements  within  a  single  scan  are  sufficiently  close  and  are 
suitable  for  interpolation.  Notice  that  if  the  sensor  model  is  Gaussian  h  is  linear.  Certain 
classes  of  range  measurements,  such  as  ladar,  have  been  shown  to  have  noise  characteristics 
that  can  be  described  as  Gaussian  with  outliers  [11]. 


Chapter  4 

Cramer-Rao  Error  Bounds 


The  only  description  of  the  surface  offered  by  nonparametric  estimators,  (3.2),  is  the  set  of 
points  x  in  3D  that  lie  on  the  surface.  Therefore  we  formulate  the  error  as  a  separate  bound 
for  each  surface  point.  Errors  on  points  are  directional,  but  without  any  correspondence 
between  the  estimate  and  the  true  surface,  the  only  important  aspect  of  the  error  is  how  far 
each  point  is  from  the  nearest  point  on  the  actual  surface.  Given  a  point  x,  we  can  compute 
the  CRB  as  E  [||x  —  <S||2/<S],  where  ||x  —  <S||  denotes  the  shortest  Euclidean  distance  be¬ 
tween  x  and  S,  the  actual  surface,  and  E  denotes  the  expected  value  for  all  possible  x.  The 
local  error  bound  gives  us  a  map  of  errors  over  the  entire  surface  estimate.  This  is  a  more 
useful  and  general  result  than  a  global  error  bound. 


Let  n  be  the  number  of  scanners  (range  images)  to  which  the  point  x  is  visible.  Each  of 
the  n  scanners  has  one  line  of  sight,  ,  associated  with  x.  This  is  the  vector  from  the 
scanner  location  to  x.  Let  r(t)  denote  the  range  measurement  for  the  Tth  scanner  taken  for 
the  line  of  sight  L^.  In  principle,  x  is  a  function  only  of  the  set  r^, ...,  .  Using  the 

Cramer-Rao  error  bound  formula  for  unbiased  estimators  [12],  we  find 


E  > 


2 


1 

-P(rM|s) 


dr^ 


(4.1) 


In  the  rest  of  this  paper,  we  use  E  to  denote  E  [||x  —  <S||2/<S].  Equation  (4.1)  is  a  function  of 
the  derivative  of  the  pdf  with  respect  to  S.  To  compute  this  derivative,  we  use  a  local  first- 
order  approximation  to  the  surface,  i.e.  the  tangent  plane.  Let  N  denote  the  surface  normal 
vector,  which  is  perpendicular  to  the  tangent  plane.  Then,  perturbations  of  the  surface  can 
be  locally  approximated  by  moving  the  tangent  plane  along  the  normal  direction  dS  =  eN, 
see  Figure  4.1(a).  Let  9^  denote  the  angle  between  N  and  —  L^.  Also,  let  r[t'>  denote 
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(a)  (b) 

Figure  4.1:  (a)  The  relationship  between  perturbations  of  the  surface  and  its  true  distance 
from  the  scanner,  (b)  The  2D  geometry  of  line  of  sight  error. 


the  true  distance  from  the  scanner  to  the  surface  along  L^) .  The  geometric  relationship 
between  the  surface  perturbation  e  and  the  change  in  the  true  distance  from  the  scanner  to 
the  surface,  see  Figure  4.1(a),  dictates 


A  r 


e 

cos  0b) ' 


(4.2) 


Using  this  relationship,  we  obtain 


dP(r®  |<5)  P(r®  | S  +  eN)  -P(rb)  |S) 

=  lim  — - - - - - - - 


dS 


e— >0 


p{r^\r^  +  Ar^j  —  P^j-b)| 


.(<) 


lim 

e— >0 


lim .  u) 


Ar,  — >0 


A  r. 


(0 


cos  0 b) 

^  dp[r^\r^ 


cos  0b) 

Substituting  this  result  into  (4.1)  yields 

E  >  - 


dr. 


( i ) 


Er=isec^)/0C 


dP 


^r(i)|rW^ 


dr. 


(0 


drb) 


(4.3) 


(4.4) 


The  next  step  is  to  formulate  the  conditional  pdf  for  range  measurements.  There  are  two 
possible  sources  of  error  in  each  range  measurement: 


•  the  angular  error  in  aiming  the  line  of  sight,  and 

•  the  error  in  the  distance  measurement  along  the  actual  line  of  sight. 


The  uncertainty  in  the  line-of-sight  can  be  used  to  describe  several  sources  of  error.  First, 
the  scanner  measures  range  along  a  discrete  grid  of  line-of-sights,  and  therefore,  it  intro¬ 
duces  a  sampling  error.  Moreover,  given  an  intended  line-of-sight  on  the  discrete  grid, 
there  is  an  error  in  aiming  the  range  finder.  We  will  refer  to  this  discrepancy  between  the 
intended  and  the  actual  line  of  sights  as  pointing  error.  Finally,  when  estimating  surfaces 
from  multiple  range  images,  error  is  introduced  by  imperfections  in  the  registration  of  the 
different  range  images  to  each  other. 


For  most  range  scanners,  such  as  Ladar,  the  pointing  error  is  small  compared  to  the  error 
in  the  distance  measurement.  Hence,  it  is  common  to  assume  a  perfectly  aimed  line  of 
sight,  to  simplify  the  formulation  of  the  conditional  pdf.  In  this  case,  P  (rW|<S)  depends 
only  on  the  true  distance  from  the  Tth  scanner  to  S  along  the  vector  Li/l) .  We  can  assume  a 
Gaussian  distribution  for  the  noise  in  the  distance  measurement  [5],  and  therefore 


P(r«)|S)  =F(r(i)|r<<))  ~M( ifVh 

Using  results  for  Gaussian  pdf’s  from  [12],  we  find  that 

( dP^\rf)\  2  1  dr(i)  =  a2 

f?  y  drf^  )  P(r6)|r^) 

Substituting  this  result  into  (4.4),  we  get 

E>  1 


(4.5) 


(4.6) 


(4.7) 


This  result  states  that  if  any  of  the  n  scanners  have  a  line  of  sight  that  is  perpendicular 
to  the  normal  vector  at  x  (06)  =  0),  the  error  bound  for  that  point  is  zero.  Figure  4.2 
demonstrates  this  result  with  a  sphere.  We  compute  the  CRB  for  estimating  a  surface  from 
six  noisy  range  images  of  a  sphere  with  unit  radius  taken  along  the  six  cardinal  directions. 
Figure  4.2  shows  the  CRB  as  a  colormap  on  the  surface;  the  units  are  the  radius  of  the 
sphere.  The  scanners  are  located  on  the  axis  along  the  purple  regions  on  the  estimator. 
As  predicted  by  (4.7)  these  are  the  regions  of  highest  expected  error.  The  red  regions, 
where  the  CRB  is  0,  form  six  circles  on  the  sphere.  These  circles  are  the  silhouettes  of  the 
sphere  as  seen  from  the  scanner  locations.  Therefore,  according  to  this  incomplete  CRB 
derivation,  it  should  be  possible  to  determine  the  location  of  any  desired  point  exactly  by 


(a)  __ 

0.015 

(b) 

Figure  4.2:  [Color]The  incomplete  CRB  shown  as  a  colormap  on  the  sphere,  and  (b)  the 
color  map  for  the  CRB.  The  radius  of  the  sphere  is  1  unit. 

repositioning  the  scanner.  This  counter-intuitive  result  is  due  to  ignoring  the  angular  error 
in  the  line  of  sight.  In  practice,  this  error  is  non-zero,  and  we  can  not  determine  any  point 
on  an  object  error-free.  We  derive  a  complete  conditional  pdf  and  CRB  in  the  rest  of  this 
section. 


4.1  Error  bound  in  2D 


We  can  derive  an  accurate  conditional  pdf  for  the  range  measurement  if  we  take  the  pointing 
error  in  the  line  of  sight  into  account.  Let  us  first  examine  the  simpler  2D  case,  where 
Q  c  IR2  and  <5  is  a  curve.  The  vector  from  the  fth  scanner  to  x  on  the  surface  estimator, 
LW,  is  now  the  intended  line  of  sight.  Figure  4.1(b)  illustrates  L(o:)  and  a  which  represent 
the  actual  line  of  sight  (random  variable  A)  and  the  angle  it  makes  with  the  intended  line  of 
sight,  respectively.  We  assume  that  the  pdf  for  a  is  a  Gaussian  with  zero  mean  (there  is  no 
constant  offset  error  in  aiming  the  scanner)  and  aa  standard  deviation 

P(a)~Af(0,a2a).  (4.8) 

Given  this  actual  line  of  sight,  we  assume  a  Gaussian  distribution  for  the  distance  measure¬ 
ment  (random  variable  B) 

P  (j-b)  |L(a),  <S)  =  P  (j-b)|r(a))  ~  J\f(r(a),  a2),  (4.9) 

where  r(a )  is  the  actual  distance  to  the  surface  S  along  L(o:).  Random  variables  A  and  B 
are  independent;  therefore,  their  joint  probability  is  the  product  of  (4.8)  and  (4.9).  Integrat- 


ing  this  joint  probability  over  the  domain  of  a,  we  compute  the  marginal  distribution 

P(r{i)\S)=f  P  (r(i)jL(a),S)  P(a)da.  (4.10) 

J  —  7T 

To  evaluate  this  probability,  we  still  need  to  determine  the  expression  for  r(a)  in  (4.9). 


Without  loss  of  generality,  define  the  scanner  location  and  1/9  to  be  the  origin  of  the 
coordinate  frame  and  the  y-axis,  respectively.  Then,  we  have  L(cr)  = 


sm  a 
cos  a; 


and  N 


/  sin  0(9 
ycos  0(9 


,  see  Figure  4.1(b).  Using  the  equation  for  the  tangent  line 


(r(a)L(a)  -  •  N  =  0, 

the  distance  r(a)  can  be  found  as 


(4.11) 


r(a) 


rw  LW  • N 

*  L(a)-N 

r(i) _ cos  0 (9 _ 

1  cos  a  cos  0(9  —  sin  a  sin  0(9 
(.)  cos  0(9 
r<  cos  0(9  —  a  sin  0(9 

(l  +  o;  tan  0(9) 


(4.12) 

(4.13) 


Equation  (4.12)  follows  from  the  fact  that  a  is  very  small,  and  therefore  sin  a  a  and 
cos  a;  ~  1.  Equation  (4.13)  is  obtained  using  a  first  order  Taylor  series  approximation  to 
(4.12)  around  a  =  0. 


Let  us  put  together  equations  (4.8-4.10)  and  (4.13)  to  evaluate  P  ( V (9 1<5) 

poo  2  (r-W  — rt(,)(i+atan0W))  j  _  a2 

/  _ — e  _ — e  da.  (4.14) 

J — oo  v  27raa 

We  can  change  the  range  of  integration  from  (— tt,  it)  in  (4.10)  to  (— oo,  oo)  above  because 
<ja  tt,  and  hence  P(a)  ~  0  for  \a\  >  tt.  Then,  using  the  change  of  variables  y  = 
tan  0(9 a,  the  above  integral  can  be  rewritten  as 


(d’Urf)  j,)' 


\/2tt t 


-e  dy, 


TTG ' 


e 


(4.15) 


where 


°'a  =  rt'>  tan  9^aa.  (4.16) 

Equation  (4.15)  is  in  the  form  of  convolution  of  two  Gaussians.  Consequently,  probability 
theory  states  that  the  result  is  the  Gaussian  pdf 

P  (r«>|S)  =  P  (rW|rf, «(,))  ~  V  (rf,  o?  +  «)2)  .  (4.17) 


For  the  purposes  of  differentiating  this  pdf  with  respect  to  rt  ’ ,  we  ignore  the  dependence 
of  o'a  on  r[l) .  Hence,  the  derivation  (4.3)  also  applies  here.  Using  results  for  Gaussian  pdf’s 
from  [12],  we  find  that 


/ 

JtM 


(d.P{r®  | 

z 

1 

V  drt]  ) 

lp(r(0 

r  «.»(•)) 

dr{l]=a2r  +  (o'af 


(4.18) 


Finally,  using  these  result  in  (4.1) 


Ya=i  sec  +  (rf )  tan  j 

yS  1  !  (4.19) 

1  cos  tfWcr^+sintfW 


Note  that,  provided  of  ^  0  and  a2a  ^  0,  which  is  always  the  case  for  a  real  range  finder, 
(4.19)  is  neverO. 


4.2  Error  bound  in  3D 


The  3D  case  differs  from  the  2D  because  there  are  two  angles  of  deviation  in  the  line  of  sight 
that  we  need  to  consider;  however,  we  show  that  only  one  of  these  angles  matter  and  the 
3D  case  can  be  reduced  to  the  2D  case.  Consider  the  geometry  illustrated  in  Figure  4.3(a). 
Without  loss  of  generality,  define  the  scanner  location  and  (the  intended  line  of  sight) 
to  be  the  origin  of  the  coordinate  frame  and  the  z-axis,  respectively.  The  surface  can  be 
locally  approximated  by  its  tangent  plane  defined  by  the  surface  normal  vector  N.  Using 
N,  define  the  following  unit  vectors: 

v  =  N  x  z  and  u  =  v  x  z,  (4.20) 

where  z  is  the  unit  vector  in  the  direction  of  the  z-axis ,  and  “x”  denotes  the  vector  cross 
product.  The  unit  vectors  u,  v  and  z  define  an  orthonormal  coordinate  frame. 


Figure  4.3:  (a)  The  3D  geometry  of  line  of  sight  error,  (b)  the  u-v-z  coordinate  frame. 


The  two  angles  of  deviation  for  the  line  of  sight  can  be  defined  as  rotations  of  the  intended 
line  of  sight  around  any  pair  of  orthogonal  pair  of  vectors  in  the  plane  perpendicular  to  the 
z-axis.  Without  loss  of  generality,  we  choose  the  angles  of  deviation  a  and  [3  to  be  rotations 
around  the  v  and  u  axes,  respectively,  as  shown  in  Figure  4.3(b).  The  random  variables  a 
and  f3  are  independent  and  identically  distributed  with  the  pdf  J\f  (0,  a%).  The  intended  line 
of  sight  is  LiW  =  (0  0  l)  in  the  u-v-z  coordinate  frame.  The  actual  lines  of  sight  can 
be  expressed  in  the  u-v-z  coordinate  frame  as 


L  (a,/3) 


1 

y/ sin2  a  +  sin2  ft  +  1 


1 

y/ a2  +  /32  +  1 


(4.21) 


where  we  have  used  the  small  angle  approximation  sin  a  ~  a  and  sin  /3  ~  [3.  We  can  also 
express  the  surface  normal  in  the  same  coordinate  frame.  By  definition,  N  •  LW  =  N  •  z  = 
—  cos  N-v  =  N-(Nxz)  =  0  and  |  |Nj  |  =  1;  therefore, 


N  = 


/  sin  0W 

°  • 

ycos  0W 


We  can  use  the  equation  for  the  tangent  plane,  which  is  the  same  as  equation  (4.1 1)  for  the 


tangent  in  2D,  to  find  the  distance  r(a,  ft) 


r(a,ft) 


g)  LW-N 

r<  L(o;,  ft)  •  N 
(i)  cos  0^  \J  ot2  +  ft2  +  1 
Tt  cos  0(9  —  a  sin  0(9 
(l  +  a  tan  0 (9) 


(4.22) 


Equation  (4.22),  which  is  exactly  the  same  result  as  (4.13)  for  2D,  follows  from  a  first  order 
Taylor  series  approximation  around  a  =  ft  =  0.  Hence,  the  Cramer- Rao  bound  (4.19)  also 
applies  to  the  3D  case. 


Chapter  5 

Results  and  Discussion 


Figure  5.1  shows  the  results  of  the  experiment  from  Figure  4.2  with  the  complete  CRB 
formulation  (4.19),  which  includes  angular  error.  As  expected  the  CRB  does  not  go  to  zero 
along  occlusion  boundaries.  This  is  in  contrast  to  the  incomplete  CRB  formulation,  which 
predicts  a  zero  error  bound  for  the  silhouette  of  a  sphere. 

As  an  alternative  to  the  CRB  results  in  this  paper,  consider  the  method  of  computing  error 
measures  on  simple  scalar  estimators,  which  averages  all  measurements.  For  such  an  es¬ 
timator  to  be  the  error  E  >  a'2 /n,  where  n  is  the  number  of  measurements  and  o2  is  the 
variance  of  any  one  measurement.  An  naive  application  of  this  scheme  to  surface  recon¬ 
struction  would  produce  an  error  measure  that  depended  only  on  the  number  of  scanners 
that  are  visible  from  any  particular  surface  point.  Unlike  the  CRB  derived  in  this  paper, 
this  trivial  result  does  not  take  the  sensor-model  geometry  into  account  and  is  not  correct. 
In  Figure  5.1,  the  CRB  is  highest  (purple-blue)  in  regions  seen  by  a  single  scanner,  and 
lowest  (yellow)  in  regions  seen  by  three  scanners.  However,  the  CRB  varies  significantly 
within  these  regions  which  can  not  be  predicted  by  the  trivial  approach  that  discounts  the 
sensor-model  geometry. 

Next,  we  compute  an  actual  estimator  using  a  level-set  surface  representation  [5].  Fig¬ 
ure  5.1(b)  shows  a  close-up  view  of  the  CRB  colormapped  on  to  this  actual  estimator.  If 
we  consider  the  roughness  of  the  estimated  surface  as  a  subjective  indicator  of  error,  we  ob¬ 
serve  that  the  actual  estimation  errors  are  approximately  proportional  to  the  error  predicted 
by  the  CRB.  In  other  words,  the  estimator  is  indeed  more  noisy  in  blue-purple  regions  of 
the  CRB  compared  to  the  yellow  regions. 


Finally,  we  demonstrate  the  importance  of  error  bounds  in  a  real  surface  reconstruction 
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Figure  5.1:  [Color] (a)  The  CRB  colormapped  on  the  sphere,  (b)  a  close-up  view  of  the 
CRB  shown  on  an  instance  of  the  estimator,  and  (c)  the  color  map  for  the  CRB.  The  radius 
of  the  sphere  is  1  unit. 


Figure  5.2:  [Color]  MLE  reconstruction  from  (a)  4  range  images,  (b)  12  range  images,  and 
(c)  CRB  colorbar.  The  units  of  the  CRB  is  in  millimeters  (mm).  The  diameter  of  the  barrel 
in  the  scene  is  approximately  500  mm.  The  black  regions  have  infinite  CRB;  these  are  the 
points  not  seen  by  any  scanner. 


problem.  Figure  5.2  illustrates  the  CRBs  computed  for  reconstructions  of  an  office  scene. 
Twelve  range  images  were  taken  and  registered  with  the  methods  described  in  [14].  Then 
using  a  level  set  representation,  we  reconstruct  a  surface  model  [5].  In  the  first  reconstruc¬ 
tion,  we  use  only  4  out  of  the  12  range  images.  The  occlusion  shadows  of  the  barrel  and  the 
chair  are  observed  as  the  black  regions  on  the  reconstructed  surface  in  Figure  5.2(a).  Very 
high  CRB  values  (purple)  are  also  observed  at  various  locations  including  the  top  of  the 
desk,  and  on  the  bookshelves  due  to  the  occlusions  of  objects  placed  on  it.  Unlike  the  oc¬ 
clusion  shadows  of  the  chair  and  the  barrel,  these  artifacts  are  not  immediately  observable 
from  the  reconstructed  surface.  Hence,  the  CRB  image  brings  out  useful  information  that 
can  be  used  to  choose  further  scanning  locations.  In  the  second  reconstruction,  we  use  all 
12  range  images.  Overall,  the  average  CRB  is  lower  as  expected  and  there  are  much  fewer 
occluded  regions.  However,  notice  that  certain  parts  of  the  desk  and  bookshelves  still  have 
infinite  CRB  values  (black),  indicating  that  these  parts  are  occluded  in  all  12  range  images. 
This  result  can  be  used  to  add  another  range  image  from  a  scanner  location  that  can  see 
these  parts.  Or  alternatively,  it  can  inform  users  (or  some  subsequent  processing)  not  to 
trust  the  surface  estimate  in  these  locations. 


Chapter  6 
Conclusion 


This  paper  shows  the  derivation  of  a  systematic  error  measure  for  nonparametric  surface 
reconstruction  that  uses  the  Cramer-Rao  bound.  The  CRB  is  a  tight  lower  error  bound  for 
unbiased  estimators  such  as  the  maximum  likelihood.  However,  there  are  some  limitations 
in  this  formulation.  We  have  assumed  no  knowledge  of  surface  shape  other  than  that  given 
by  the  measurements.  However,  in  practice  shape  reconstruction  often  includes  some  a- 
priori  knowledge  about  surface  shape,  such  as  smoothness.  The  inclusion  of  such  priors 
corresponds  to  a  maximum  posteriori  estimation  process.  The  current  formulation  still 
gives  meaningful  results — it  tells  us  to  what  extent  a  particular  estimate  is  warranted  by  the 
data.  That  is,  it  gives  us  some  idea  of  the  relative  weighting  of  the  data  and  the  prior  at 
each  point  on  the  surface.  Future  work  will  include  a  study  of  how  to  incorporate  priors 
and  estimator  bias  into  these  error  bounds. 
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